Disparity reduction for high speed serial links

ABSTRACT

System, computer program product, and computer-implemented method to improve a running disparity of an encoded bit stream in a distributed network switch, the distributed network switch comprising a plurality of switch modules including a first switch module, by receiving, at the first switch module, a raw data stream comprising a plurality of bits, receiving a bit sequence, encoding at least a first bit of the raw data stream using a corresponding at least a first bit of the bit sequence, transmitting the encoded first bit, inverting the first bit of the bit sequence, and encoding a second bit of the raw data stream using the inverted first bit.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of co-pending U.S. patent applicationSer. No. 13/599,196, filed Aug. 30, 2012. The aforementioned relatedpatent application is herein incorporated by reference in its entirety.

BACKGROUND

Embodiments disclosed herein relate to encoding raw data in a datastream. More specifically, embodiments disclosed herein relate totechniques to reduce disparity of encoded data in high speed seriallinks.

Computer fabric interconnections often involve a collection ofhigh-speed serial links. Raw (or uncoded) data is not transmitted onthese links because the characteristics of a raw data serial bit streamare not conducive to the electronics involved. Important characteristicsof an optimal serial bit stream include: (i) an adequate transitiondensity, (ii) good direct current (DC) balance, and (iii) randomness ofthe data. Raw data typically goes through a “data coding” stage prior totransmission, thereby modifying it in a predictable fashion in order toachieve these desired characteristics.

Modern solutions to reduce the risk of baseline wander (also known as DCimbalance) were moderately successful, but did not eliminate largeswings in running disparity (i.e., baseline wander calculated over aperiod of time). Disparity is a term used to identify the numericdifference between the number of zeroes and ones in a bit stream.Different primitive polynomials may be used to encode raw data, but eachmay produce different baseline wander, especially when the raw data iscomprised of constant data values. PCIe 3.0 attempted to fix thisproblem by choosing a primitive polynomial that did not include peaks orvalleys in the baseline wander graph. This solution reduced the risk ofbaseline wander moderately, but did not totally eliminate the largeswings in the running disparity. The 64B/67B encoding method (called theInterlaken Protocol) solved this problem by adding an additional bittransmitted with each word to indicate whether that word was invertedprior to transmission. However, while this solution effectively reducesbaseline wander, it does so at the expense of bandwidth, as an extra bitmust be transmitted with each word.

SUMMARY

Embodiments disclosed herein provide a system, computer program product,and computer-implemented method to improve a running disparity of anencoded bit stream in a distributed network switch, the distributednetwork switch comprising a plurality of switch modules including afirst switch module, by receiving, at the first switch module, a rawdata stream comprising a plurality of bits, receiving a bit sequence,encoding a first bit of the raw data stream using a bit of the bitsequence, inverting the first bit of the bit sequence, and encoding asecond bit of the raw data stream using the inverted first bit.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

So that the manner in which the above recited aspects are attained andcan be understood in detail, a more particular description ofembodiments of the disclosure, briefly summarized above, may be had byreference to the appended drawings.

It is to be noted, however, that the appended drawings illustrate onlytypical embodiments of this disclosure and are therefore not to beconsidered limiting of its scope, for the disclosure may admit to otherequally effective embodiments.

FIGS. 1A-1C are schematics illustrating techniques to reduce disparityin high speed serial links, according to one embodiment disclosedherein.

FIG. 2 is a flow chart illustrating a method to reduce disparity in highspeed serial links, according to one embodiment disclosed herein.

FIG. 3 is a flow chart illustrating a method to encode a data stream,according to one embodiment disclosed herein.

FIG. 4 illustrates a system architecture that includes a distributed,virtual switch, according to one embodiment described herein.

FIG. 5 illustrates the hardware representation of a system thatimplements a distributed, virtual switch, according to one embodimentdescribed herein.

DETAILED DESCRIPTION

Embodiments provide a system, computer program product, andcomputer-implemented method to improve a running disparity of an encodedbit stream in a distributed network switch. The distributed networkswitch may include a plurality of switch modules. Embodiments mayreceive, at a first one of the switch modules, a raw data streamcomprising a plurality of bits. Additionally, embodiments may receive abit sequence. Embodiments may encode a first bit of the raw data streamusing a corresponding first bit of the bit sequence. Embodiments mayalso invert the first bit of the bit sequence and use the inverted firstbit to encode a second bit of the raw data stream.

Embodiments disclosed herein relate to the problem of direct current(DC) imbalance (also called baseline wander or running disparity) whenscrambling raw data with a high-order polynomial. The techniquesdescribed herein not only reduce running disparity, but also eliminatethe need to transmit an extra bit with each word. Disparity is a termused to identify the numeric difference between the number of ones andzeroes in an encoded bit stream. Baseline wander is caused by anaccumulated excess of zeroes or ones in the bit stream, or, in otherwords, a high disparity between zeroes and ones over time. Even though aserial link may be AC-coupled, a temporary imbalance in either directioncan produce a movement in the center voltage of the eye opening,potentially increasing the bit error rate. Disparity can be calculatedover a fixed time period, or can reflect a continuous value (i.e.,running disparity). Different primitive polynomials produce differentbaseline wander profiles. The greatest risk for problems with baselinewander is during the times when the raw data is comprised of IDLE's (orany other constant data value) transmitted to maintain an active dataconnection, because XORing a constant value (such as all zeroes or allones) with a variable always produces the same result, namely, thevariable itself.

In the following, reference is made to embodiments of the disclosure.However, it should be understood that the disclosure is not limited tospecific described embodiments. Instead, any combination of thefollowing features and elements, whether related to differentembodiments or not, is contemplated to implement and practice thedisclosure. Furthermore, although embodiments of the disclosure mayachieve advantages over other possible solutions and/or over the priorart, whether or not a particular advantage is achieved by a givenembodiment is not limiting of the disclosure. Thus, the followingaspects, features, embodiments and advantages are merely illustrativeand are not considered elements or limitations of the appended claimsexcept where explicitly recited in a claim(s). Likewise, reference to“the invention” shall not be construed as a generalization of anyinventive subject matter disclosed herein and shall not be considered tobe an element or limitation of the appended claims except whereexplicitly recited in a claim(s).

As will be appreciated by one skilled in the art, aspects of the presentdisclosure may be embodied as a system, method or computer programproduct. Accordingly, aspects of the present disclosure may take theform of an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present disclosure may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain, or store a programfor use by or in connection with an instruction execution system,apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations for aspects of thepresent disclosure may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Smalltalk, C++ or the like and conventional proceduralprogramming languages, such as the “C” programming language or similarprogramming languages. The program code may execute entirely on theuser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Aspects of the present disclosure are described below with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of thedisclosure. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

FIG. 1A is a schematic illustrating a technique 101 for encoding a rawdata stream. The technique 101 is a coding mechanism which uses amaximal-length linear feedback shift register (LFSR) to generate apseudo random binary sequence (PRBS) using a selected bit from the LFSR.An exclusive or (XOR) operation is then performed between the PRBS andthe raw data to generate an encoded data stream. As shown, a pluralityof exemplary PRBS segments A-F, labeled 111-116, have been generated bythe LFSR. The segments 111-116 are divided into a predefined segmentlength of 1,000 bits or unit intervals (1K UI). These PRBS segments(111-116) are used in sequence to encode the raw data stream. Forexample, once the PRBS of the segment A are used to XOR a correspondingsegment of raw data, the new segment B is generated and used to XOR asubsequent corresponding raw data segment.

FIG. 1B is a schematic 102 illustrating techniques to encode a raw datastream to reduce disparity in high speed serial links, according to oneembodiment disclosed herein. As shown, six PRBS segments 121-126 areprovided, each comprising a 1K unit interval. The raw data stream maycomprise functional system data, IDLE line detect data, orfixed/constant data. However, rather than using the PRBS pattern shownin FIG. 1A for scrambling the data, each 1K UI segment is repeated, withthe second usage being an inverted version of the first usage. Invertinga binary bit comprises altering the value from one state to another (forexample, from “0” to “1”, or vice versa). An LFSR provides the PRBS. TheLFSR may be of any size, but in one embodiment, the LFSR is 40 bitslong, and a predefined bit position is used to select a bit from eachcycle of the LFSR to send as the next bit in the PRBS. In oneembodiment, the least significant bit of the LFSR is predefined as thebit position which is sent as the bit in the PRBS. The selection of theleast significant bit is merely illustrative, as any bit position may beselected, so long as the same bit position is selected each time. Thecontents of the LFSR could be saved at the beginning of each newsegment, then restored, so that it can be repeated with an inversion.For example, when segment A begins, the value in the LFSR could be savedto a hold register. Once segment A is completed, the initial value ofthe LFSR at segment A may be restored to the LFSR from the holdregister. A bit from the predefined bit position could then be sent outas part of the PRBS, inverted, and used to encode the next bit of theraw data stream. The LFSR may again cycle through 1,000 combinations ofinverted segment Ā, send a bit from each combination as part of the PRBSwhich could then be inverted and used to encode another 1K UI segment ofraw data. Once inverted segment Ā is completed, segment B may begin.Advantageously, when idle-line detects (IDLEs) or large blocks ofconstant data are transmitted, this technique bounds the baselinewander, as shown in FIG. 1C.

FIG. 1C is a schematic 103 illustrating a graphical result of the impactof implementing techniques to reduce disparity in high speed seriallinks, according to one embodiment disclosed herein. The schematic 103is a graph capturing the baseline wander (or running disparity) of theencoded data stream. Each segment of the graph corresponds to thesegments 121-126 of FIG. 1B, and indicates the baseline wander of thebit stream generated using the technique depicted in FIG. 1B. The “x”marks indicate the first sequence, such as sequence A, and the “o” marksindicate the inverted sequence, such as inverted sequence Ā. As shown,by inverting the sequences, the baseline wander returns to zero aftereach inverted sequence is completed, i.e. after each 2K UI. For example,if the disparity of segment A is 50, indicating that the encoded datastream contains 50 more zeroes than ones, then the inverted sequence Awould have 50 more ones than zero, and the running (total) disparitywould be zero.

FIG. 2 is a flow chart illustrating a method 200 to reduce disparity inhigh speed serial links, according to one embodiment disclosed herein.In some embodiments, the method 200 is executed by a designatedcomponent of a switch module of a distributed switch. At block 210, asegment length is defined. Although a segment length of 1000 bits (orunit intervals) was described above, the actual size can vary dependingon the implementation. Generally speaking, the segment length should notbe so small that the randomness of the data is compromised. Likewise,the segment length should not be too long, as the running disparity mayalso become too large during a given segment. At block 220, a raw datastream is received at the distributed switch. The raw data stream maycomprise functional system data, or IDLE/fixed data. At block 230,described in greater detail with reference to FIG. 3, the data stream isencoded. At block 240, the encoded data stream is transmitted by theswitch module to another switch module of the distributed switch.

FIG. 3 is a flow chart illustrating a method 300 corresponding to block230 to encode a data stream, according to one embodiment disclosedherein. The method 300 illustrates one technique to encode raw datausing a PRBS sequence which is XORed with a first segment of raw data.The method 300 then inverts the PRBS sequence, which is XORed with asubsequent segment of raw data. At block 305, a loop including blocks310-350 is executed while receiving raw data. At block 310, the initialvalue of the LFSR at the beginning of the segment is stored to atemporary hold register. For example, in embodiments where the LFSR is a40-bit register, the first 40-bit value is stored in the hold register.At block 315, a pseudo-random bit stream (PRBS) is received from theLFSR. The PRBS may be comprised of bits which are selected from apredefined bit position of the LFSR during each cycle of the LFSR. Inone embodiment, the least significant bit position is selected. At block320, a first segment of the raw data stream is encoded by XORing thebits of the PRBS with the bits of the first segment of the raw datastream. At block 325, the encoded first segment of the raw data streamis transmitted to another switch module in the distributed switch.

At block 330, the LFSR is restored using the contents of the holdregister. For example, a 40-bit value stored in the hold register may becopied to the LFSR, which corresponds to the initial value in theprevious sequence. At block 335, bits from the selected bit position aretransferred as the PRBS; however, after exiting the LFSR, the bits ofthe PRBS are inverted. At block 340, a second segment of the raw datastream is encoded by XORing the inverted bits of the PRBS with the bitsof the second segment of the raw data stream. As described above, thefirst segment and the second segment sizes are defined by thepredetermined segment length, and a corresponding number of bits areencoded. For example, where the segment length is 1,000 UI, the LFSRwill generate 1,000 bits for the PRBS, which, in the first sequence, areused to encode the first segment of 1,000 bits of the raw data stream.For the second segment, the 1,000 bits will be inverted and used toencode the second segment of the raw data stream, which is also 1,000bits long. At block 345, the encoded second segment of the raw datastream is transmitted to another switch module in the distributedswitch.

Serial link protocols typically define a method for synchronizing a“transmit LFSR” code with a “receive LFSR” code. To incorporateembodiments disclosed herein, a given protocol may need to be modifiedto guarantee that the “receive LFSR” knows whether it should start witha “true” LFSR segment, or an “inverted” LFSR segment. Additionally,inversion logic may be placed between the LFSR and the XOR gate wherethe encoding is performed. The inversion logic, in one embodiment, maybe an XOR gate which receives the PRBS from the LFSR as one input, and acontrol signal which indicates whether or not the PRBS should beinverted. For example, a “1” XORed with any value inverts the value.Therefore, a “1” would indicate when the bits would need to be inverted,and a “0” would pass the bits through without inversion.

FIG. 4 illustrates a system architecture 400 that includes adistributed, virtual switch, according to one embodiment disclosedherein. The first server 405 may include at least one processor 409coupled to a memory 410. The processor 409 may represent one or moreprocessors (e.g., microprocessors) or multi-core processors. The memory410 may represent random access memory (RAM) devices comprising the mainstorage of the server 405, as well as supplemental levels of memory,e.g., cache memories, non-volatile or backup memories (e.g.,programmable or flash memories), read-only memories, and the like. Inaddition, the memory 410 may be considered to include memory storagephysically located in the server 405 or on another computing devicecoupled to the server 405.

The server 405 may operate under the control of an operating system 407and may execute various computer software applications, components,programs, objects, modules, and data structures, such as virtualmachines 411.

The server 405 may include network adapters 415 (e.g., converged networkadapters). A converged network adapter may include single root I/Ovirtualization (SR-IOV) adapters such as a Peripheral ComponentInterconnect Express (PCIe) adapter that supports Converged EnhancedEthernet (CEE). Another embodiment of the system 400 may include amulti-root I/O virtualization (MR-IOV) adapter. The network adapters 415may further be used to implement of Fiber Channel over Ethernet (FCoE)protocol, RDMA over Ethernet, Internet small computer system interface(iSCSI), and the like. In general, a network adapter 415 transfers datausing an Ethernet or PCI based communication method and may be coupledto one or more of the virtual machines 411. Additionally, the adaptersmay facilitate shared access between the virtual machines 411. While theadapters 415 are shown as being included within the server 405, in otherembodiments, the adapters may be physically distinct devices that areseparate from the server 405.

In one embodiment, each network adapter 415 may include a convergedadapter virtual bridge (not shown) that facilitates data transferbetween the adapters 415 by coordinating access to the virtual machines411. Each converged adapter virtual bridge may recognize data flowingwithin its domain (i.e., addressable space). A recognized domain addressmay be routed directly without transmitting the data outside of thedomain of the particular converged adapter virtual bridge.

Each network adapter 415 may include one or more Ethernet ports thatcouple to one of the bridge elements 420. Additionally, to facilitatePCIe communication, the server may have a PCI Host Bridge 417. The PCIHost Bridge 417 would then connect to an upstream PCI port 422 on aswitch element in the distributed switch 480. The data is then routedvia the switching layer 430 to the correct downstream PCI port 423 whichmay be located on the same or different switch module as the upstreamPCI port 422. The data may then be forwarded to the PCI device 450.

The bridge elements 420 may be configured to forward data framesthroughout the distributed virtual switch 480. For example, a networkadapter 415 and bridge element 420 may be connected using two 40 GbitEthernet connections or one 100 Gbit Ethernet connection. The bridgeelements 420 forward the data frames received by the network adapter 415to the switching layer 430. The bridge elements 420 may include a lookuptable that stores address data used to forward the received data frames.For example, the bridge elements 420 may compare address data associatedwith a received data frame to the address data stored within the lookuptable. Thus, the network adapters 415 do not need to know the networktopology of the distributed switch 480.

The distributed virtual switch 480, in general, includes a plurality ofbridge elements 420 that may be located on a plurality of a separate,though interconnected, hardware components. To the perspective of thenetwork adapters 415, the switch 480 acts like one single switch eventhough the switch 480 may be composed of multiple switches that arephysically located on different components. Distributing the switch 480provides redundancy in case of failure.

Each of the bridge elements 420 may be connected to one or moretransport layer modules 425 that translate received data frames to theprotocol used by the switching layer 430. For example, the transportlayer modules 425 may translate data received using either an Ethernetor PCI communication method to a generic data type (i.e., a cell) thatis transmitted via the switching layer 430 (i.e., a cell fabric). Thus,the switch modules comprising the switch 480 are compatible with atleast two different communication protocols—e.g., the Ethernet and PCIecommunication standards. That is, at least one switch module has thenecessary logic to transfer different types of data on the sameswitching layer 430.

As shown, each ingress and egress port of the switching layer 430 has anencoding logic 435, which is used to encode raw data streams. Althoughnot shown, the encoding logic 435 includes an LFSR and a hold register,as well logic capable of performing the techniques described above. Theencoding logic 435 uses the techniques described above to encode rawdata streams, namely by encoding a first raw data segment using a firstLFSR PRBS, then encoding a second segment of raw data using the invertedLFSR PRBS.

Although not shown in FIG. 4, in one embodiment, the switching layer 430may comprise a local rack interconnect with dedicated connections whichconnect bridge elements 420 located within the same chassis and rack, aswell as links for connecting to bridge elements 420 in other chassis andracks.

After routing the cells, the switching layer 430 may communicate withtransport layer modules 426 that translate the cells back to data framesthat correspond to their respective communication protocols. A portionof the bridge elements 420 may facilitate communication with an Ethernetnetwork 455 which provides access to a LAN or WAN (e.g., the Internet).Moreover, PCI data may be routed to a downstream PCI port 423 thatconnects to a PCIe device 450. The PCIe device 450 may be a passivebackplane interconnect, as an expansion card interface for add-inboards, or common storage that can be accessed by any of the serversconnected to the switch 480.

Although “upstream” and “downstream” are used to describe the PCI ports,this is only used to illustrate one possible data flow. For example, thedownstream PCI port 423 may in one embodiment transmit data from theconnected to the PCIe device 450 to the upstream PCI port 422. Thus, thePCI ports 422, 423 may both transmit as well as receive data.

A second server 406 may include a processor 409 connected to anoperating system 407 and memory 410 which includes one or more virtualmachines 411 similar to those found in the first server 405. The memory410 of server 406 also includes a hypervisor 413 with a virtual bridge414. The hypervisor 413 manages data shared between different virtualmachines 411. Specifically, the virtual bridge 414 allows directcommunication between connected virtual machines 411 rather thanrequiring the virtual machines 411 to use the bridge elements 420 orswitching layer 430 to transmit data to other virtual machines 411communicatively coupled to the hypervisor 413.

An Input/Output Management Controller (IOMC) 440 (i.e., aspecial-purpose processor) is coupled to at least one bridge element 420or upstream PCI port 422 which provides the IOMC 440 with access to theswitching layer 430. One function of the IOMC 440 may be to receivecommands from an administrator to configure the different hardwareelements of the distributed virtual switch 480. In one embodiment, thesecommands may be received from a separate switching network from theswitching layer 430.

Although one IOMC 440 is shown, the system 400 may include a pluralityof IOMCs 440. In one embodiment, these IOMCs 440 may be arranged in ahierarchy such that one IOMC 440 is chosen as a master while the othersare delegated as members (or slaves).

FIG. 5 illustrates the hardware representation of a system 500 thatimplements a distributed, virtual switch, according to one embodimentdisclosed herein. Server 510 and 512 may be physically located in thesame chassis 505; however, the chassis 505 may include any number ofservers. The chassis 505 also includes a plurality of switch modules550, 551 that include one or more sub-switches 554 (i.e., a microchip).In one embodiment, the switch modules 550, 551, 552 are hardwarecomponents (e.g., PCB boards, FPGA boards, etc.) that provide physicalsupport and connectivity between the network adapters 415 and the bridgeelements 420. In general, the switch modules 550, 551, 552 includehardware that connects different chassis 505, 507 and servers 510, 512,514 in the system 500 and may be a single, replaceable part in thecomputing system.

The switch modules 550, 551, 552 (e.g., a chassis interconnect element)include one or more sub-switches 554 and an IOMC 555, 556, 557. Thesub-switches 554 may include a logical or physical grouping of bridgeelements 420—e.g., each sub-switch 554 may have five bridge elements420. Each bridge element 420 may be physically connected to the servers510, 512. For example, a bridge element 420 may route data sent usingeither Ethernet or PCI communication protocols to other bridge elements420 attached to the switching layer 430 using the routing layer.However, in one embodiment, the bridge element 420 may not be needed toprovide connectivity from the network adapter 415 to the switching layer430 for PCI or PCIe communications.

Each switch module 550, 551, 552 includes an IOMC 555, 556, 557 formanaging and configuring the different hardware resources in the system500. In one embodiment, the respective IOMC for each switch module 550,551, 552 may be responsible for configuring the hardware resources onthe particular switch module. However, because the switch modules areinterconnected using the switching layer 430, an IOMC on one switchmodule may manage hardware resources on a different switch module. Asdiscussed above, the IOMCs 555, 556, 557 are attached to at least onesub-switch 554 (or bridge element 420) in each switch module 550, 551,552 which enables each IOMC to route commands on the switching layer430. For clarity, these connections for IOMCs 556 and 557 have beenomitted. Moreover, switch modules 551, 552 may include multiplesub-switches 554.

The dotted line in chassis 505 defines the midplane 520 between theservers 510, 512 and the switch modules 550, 551. That is, the midplane520 includes the data paths (e.g., conductive wires or traces) thattransmit data between the network adapters 415 and the sub-switches 554.

Each bridge element 420 connects to the switching layer 430 via therouting layer. In addition, a bridge element 420 may also connect to anetwork adapter 415 or an uplink. As used herein, an uplink port of abridge element 420 provides a service that expands the connectivity orcapabilities of the system 500. As shown in chassis 507, one bridgeelement 420 includes a connection to an Ethernet or PCI connector 560.For Ethernet communication, the connector 560 may provide the system 500with access to a LAN or WAN (e.g., the Internet). Alternatively, theport connector 560 may connect the system to a PCIe expansion slot—e.g.,PCIe device 450. The device 450 may be additional storage or memorywhich each server 510, 512, 514 may access via the switching layer 430.Advantageously, the system 500 provides access to a switching layer 430that has network devices that are compatible with at least two differentcommunication methods.

As shown, a server 510, 512, 514 may have a plurality of networkadapters 415. This provides redundancy if one of these adapters 415fails. Additionally, each adapter 415 may be attached via the midplane520 to a different switch module 550, 551, 552. As illustrated, oneadapter of server 510 is communicatively coupled to a bridge element 420located in switch module 550 while the other adapter is connected to abridge element 420 in switch module 551. If one of the switch modules550, 551 fails, the server 510 is still able to access the switchinglayer 430 via the other switching module. The failed switch module maythen be replaced (e.g., hot-swapped) which causes the IOMCs 555, 556,557 and bridge elements 420 to update the routing tables and lookuptables to include the hardware elements on the new switching module.

As shown, each ingress and egress port of the switching layer 430contains an encoding logic 435 which encodes raw data using thetechniques described above. The encoding logic 435 may contain, asdescribed above, an LFSR, a hold register to store values generated bythe LFSR, and logic capable of performing the above-describedfunctionality.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods and computer program products according to variousembodiments of the present disclosure. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

While the foregoing is directed to embodiments of the presentdisclosure, other and further embodiments of the disclosure may bedevised without departing from the basic scope thereof, and the scopethereof is determined by the claims that follow.

What is claimed is:
 1. A computer-implemented method of encoding a bitstream to improve a running disparity of the encoded bit stream in adistributed network switch that includes a plurality of switch modules,comprising: receiving, at a first one of the plurality of switchmodules, a raw data stream comprising a plurality of bits; receiving abit sequence comprising a plurality of bits; encoding a first bit of theraw data stream using a corresponding first bit of the bit sequence;inverting the first bit of the bit sequence; and encoding a second bitof the raw data stream using the inverted first bit and by operation ofone or more computer processors.
 2. The method of claim 1, whereinencoding the first bit of the raw data stream comprises performing anexclusive or (XOR) between the first bit of the raw data stream and thefirst bit of the bit sequence, wherein encoding the second bit of theraw data stream comprises performing an XOR between the second bit ofthe raw data stream and the inverted first bit.
 3. The method of claim1, wherein the bit sequence is received from a linear feedback shiftregister (LFSR).
 4. The method of claim 3, further comprising: prior toinverting the second bit of the bit sequence: storing the first bit ofthe bit sequence at a first location; and subsequent to encoding thefirst bit of the raw data stream: restoring the first bit of the bitsequence from the first location to the LFSR; and transmitting therestored first bit from the LFSR for inversion.
 5. The method of claim1, wherein the raw data stream comprises at least one of: (i) functionalsystem data, (ii) idle-line detect data and (iii) fixed data.
 6. Themethod of claim 1, wherein a predefined segment length is used to definea count of a number of bits of the raw data stream that are encodedusing an equal number of bits from the bit sequence prior to invertingthe first bit from the bit sequence to encode a next bit of the raw datastream.
 7. The method of claim 1, further comprising transmitting thefirst encoded bit and the encoded second bit to a downstream switchmodule.